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Elementary and Secondary Education Act - Chapter 1 

FINAL EVALUATION REPORT 
READING RECOVERY™ PROGRAM 
1993-94 

ABSTRACT 

Program Description : The purpose of the 1993-94 Reading Recovery program was to provide eariy 
inten^ention to underachieving first-grade pupils who appeared unlikely to team to read successfully without 
intensive instruction. The program featured individualized one-on-one tessons provided by specially 
trained teachers. The tessons were based on obsen^ational tasks designed to provide a conprehensive 
assessnient of the pupil's devetopment of reading and writing strategies. 

The Reading Recovery program was piloted in Columbus Public Schools during the 1984-65 school 
year, with the 1993-94 school year being the tenth continuous year of the program. The program was a 
joint effort of educators in the Columbus Public Schools, the College of Education of The Ohio State 
University, and the Ohio Department of Education and was funded by Etementary and Secondary 
Education (ESEA) - Chapter 1 monies. During 1993-94 the Reading Recovery program was located in 38 
elementary schools, had a staff of 61 teachers (22.0 ITEs) and served 402 pupils. Most teachers served 
part-time in the program and part-time in the Early Literacy program. 

Time Interval: For evaluation purposes the Reading Recovery program started on September 20, 1993 and 
continued through May 13, 1994. Pupils included in the final analyses for Desired Outcomes 1 , 2, and 3 
must have received 60 or more instructional lessons or have been successfully discontinued (conpleted) 
from the prograrri. To be inckided in the analysis of standardized test achievement, pupils must have 
received 60 or more instructional lessons or have been successfully discontinued and have had a valid 
posttest score on a nationally standardized achtevement test. 

AdKltifis: To help pupils develop reading strategies, daily 30-minute individualized lessons included a 
variety of instructional activities, such as reading and re-reading books while the teacher recorded their 
strategies and enors, writing and reading their own stories, letter identification, and sound analysis of 
words. 

Achievement Qbje<nive: Pupils were to receive Reading Recovery instmction until they were ready to be 
successfully discontinued from the program. Discontinued pupils were those who successfully conpleted 
the program according to (a) predetermined levels on obsen^ational tasks indicating that the pupils were 
readirig at the average level for the district, and (b) teacher judgment that the pupils had developed 
effective reading strategies and could team in the nonnal classroom setting without extra individual help. 

E valuation Design ; The evaluation design included three desired outcomes: (1) at teast 50 percent of the 
pupils wfx) had received 60 or more lessons or were discontinued wouW display at teast once throughout 
the instructional period each of three reading strategic processing behaviors; (2) at teast 75 percent of the 
pupils who had received 60 or more lessons or were discontinued wouW not be retained; and (3) at teast 50 
percent of pupils who received 60 or more lessons or were discontinued wouW read at teast five books at 
text reading level 8 (appropriate Scott Foresman text reading level for promotion to grade 2) or above In 
addition to the three desired outcomes, three evaluatfon questions were included in the evaluation design 
based upon two major program goals: to devetop and provkie the Reading Recovery program for first 
grade chiWren, and to adopt and apply the necessary inservtee program for teachers. Questfons were 
asked in the foltowing areas: (a) service pattems of pupils; (b) perfomiance levels of Reading Recoven^ 
pupils on a standardized test of reading; and (c) tong term effects. 

The major evaluatfon effort was to be accomplished through teacher evaluation of pupil reading 
strategic processing behavfors, pupil independent reading achievement, and the administratfon of the 
Metropolrtan Achievement Tests, Level Primer, Forni L, 1985 (fMT6) for spring testing. Analyses of the 
standardized test data included percentiles and districtwkie average NCE scores. Although not part of the 
evaluation design, parent involvement data were also collected by program teachers. Locally constmcted 
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instruments were used to collect enrollment/attendance and parent involvement data. District conputer 
files were used for retention data. 



Major Findings/Recommendations: The Reading Recovery program served 402'pupils in 1993-94. with 
average pupil enrollment of 62.0 days. Average pupil attendance was 53.8 days and the average number 
of instmctional lessons was 42.9. The treatment group consisted of the 145 pupils who were either 
discontinued (105) or received 60 or more lessons but. not discontinued (40). Program developers have 
estimated that most pupils need approximately 60 lessons to complete the program. Of the treatment 
group pupils, 137 had valid MAT6 Total Reading scores, were English-speaking, and were included in the 
evaluation sample. 

The three desired outcomes for the 1993-94 Reading Recovery program were met. Of the 145 
treatment group pupils, 135 (93.1%) displayed over time each of the three reading strategic processing 
behaviors, including monitoring reading, constructing meaning, and integrating sources of information 
(criterion was 50.0%). Of the 145 pupils in the treatment group, retention data were available for 142 
pupils. Of these 142 pupils. 139 (97.9%) were not retained (criterion was 75.0%). Of the 145 treatment 
group pupils. 138 (95.2%) read five or nx)re books at text reading level 8 or above (criterion was 50.0%). 

Records of parent contacts and activities maintained by program teachers for the 402 pupils served 
indicated 434 different parents or guardians were involved in some way with the program. These 434 
indivkJuals made a total of 1105 contacts with program teachers. The 145 treatment group pupils 
represented 36.1% of the 402 pupils sen/ed, but represented 51.0% (563) of the total nurrt>er of contacts 
and 41 .7% (1 81 ) of the indivkJual parents involved in the program. 

Twenty-six (19.0%) of the evaluatfon sample pupils reached the average NCE (42.2) for the district as 
a whole. The percentages of pupils who were at various percentile levels on the posttest were as follows: 
(a) 1 3.9% (1 9) were at the 50%ile or above (grade level); and (b) 81 .0% (111) were betow the 37%ile and 
still eligible for Chapter 1 sen/rces. 

Results of the analyses of the tong-temi effecis of Reading Recovery revealed the foltowing. Of the 
fonner Reading Recovery pupils who were in a school and at a grade level where a compensatory 
education program was in operatfon in 1993-94, 34.6% (37) of the pupils from the 1991-92 treatrrient group 
and 42.7% (64) of the pupils from the 1992-93 treatment group were still being served in a conpensatory 
education program. Of the 362 pupils from the 1991-92, 1992-93. and 1993-94 treatment groups who 
remained in the Columbus Public Schools through November 1994, 89.2% (323) foltowed a normal grade- 
level progressk)n. The retentk)n rates for grade 1 were: 1 .7% for the 1991-92 treatment group, 8.1% for 
the 1992-93 treatment group. 2.1% for the 1993-94 treatment group, and 4.3% for the three treatment 
groups combined. 

Based on evaluatk)n results it is recommended that the Reading Recovery program be continued, with 
attention given to the foltowing addittonal recommendattons: (a) examining the process for transferring 
pupils from the Reading Recovery program to the Eariy Literacy program; (b) expiring ways to reduce the 
amount of time program teachers spend v/ith record keeping; (c) increasing parent involvement; (d) 
kJentifying pupils needing special educatfon instructfon at the eariiest possible date; (e) provkJing 
opportunities for co-ordinatk)n between the program and classroom teachers; (f) maintaining a viable 
insen^ice program for program teachers; and (g) establishing a structured process obsen/atton procedure. 
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FINAL EVALUATION REPORT 
READING RECOVERYTM PROGRAM 
1993-94 

Program Description 

The purpose of the 1993-1994 Reading Recovery™ program was to provide eariy intervention to 
underachieving first-grade pupils who appeared unlikely to leam to read successfully without intensive 
instruction. To accomplish this purpose the program featured individualized oneK)n-one lessons 30 
mifiutes daily provided by specially trained teachers. The lessons were based on observational tasks 
whfch were designed to provide a comprehensive assessment of the pupiFs development of reading and 
writing strategies. 

The Reading Recovery program began in Columbus Public Schools during the 1984-85 school year, 
with a pitot program at 6 schools, serving 70 pupils taught by 14 teachers. During 1993-94, the prograrri 
served pupils at 38 schools, with a teaching staff of 61 teachers (22.0 FTEs-Full Time Equivalrits). Table 
1 shows staffing, number of schools, and pupils served for the ten years of the program's existence. 

Most Reading Recovery teachers were assigned indivklually to a buikJing. working half the day in the 
Reading Recovery program and half the day in the Eariy Literacy program. Typfcally a program teacher 
taught three Reading Recovery pupils for 30 minutes each and four groups of six Eariy Literacy pupils for 
40-45 minutes each. 

In 1993-94 the Reading Recovery program was k)cated in the foltowing 38 elementary schools. 



Schools Served by the Reading Recovery Program 
1993-94 



Ariington Pari< 


East Columbus 


Lincoln Pa\k 


Southwood 


Avondale 


East Linden 


Linden 


Sullivant 


Beck 


Eastgate 


Livingston 


Trevitt 


Binns 


Fairmoor 


Main 


Weinland Park 


Broadleigh 


Fairwood 


Medary 


West Broad 


Burroughs 


Heyl 


North Linden 


West Mound 


Gassady 


Highland 


Ohio 


Westgate 


Dana 


Hudson 


Olde Orchard 


Windsor 


Deshler 


Huy 


Reeb 




Eakin 


Innis 


Second 





Schools were chosen for inclusion in the program according to the percent of pupils attending a school 
who were eligible for a free or reduced priced lunch (F & RPL). Those schools with the highest percentage 
F & RPL are included in the program each year, with the total number of schools involved in the program for 
a given year determined by the availability of funding for that year. 

The 61 program teachers received support from two teacher leaders who served as trainers, resource 
teachers, program coordinators, and program teachers. The teacher leaders taught a required credit 
course for the first-year Reading Recoveiy teachers (10 teachers out of 61) and provided inservice training 
for the experienced program teachers (47 teachers out of 61 ). Additionally, four of the 61 teachers received 
extended training to become future teacher leaders. Funding for the program was provided by Elementary 
and Secondary Education (ESEA) - Chapter 1 monies. 
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Table 1 

Staffing. Schoois, and Pupils Served 
Reading Recovery™ Program 
Columbus Public Sctxjols 
1984-1994 



School 
Year 


Teachers 


Teacher 
Full-Time 
Equivalents (PTE) 


Schools 


Pupils 
Served 


1 984-85^1 


14 


7 0 


c 

u 


/ u 


1985-86 


30 


16.0 


12 


224 


1986-87 


52 


26.0 


20 


335 


1987-88 


57^ 


29.0 


26 


393 


1988-89 


49" 


23.8 


26 


283 


1989-90 


ee^ 


29.0 


31 


51 4<' 


1990-91 


60* 


20.0 


38 


297 


1991-92 


48< 


13.0 


41 


227 


1992-93 


669 


16.5 


60 


305 


1993-94 


61^^ 


22.0 


38 


402 


^Pitot year. 



^Plus support staff including 3 teacher leaders and 1 Ohio State University affiliated teacher. 



^Includes 5 teacher leaders and 3 teacher leaders-in-training. 
^Includes 150 pupils with group service only. 
^Includes 2 teacher leaders and 3 teacher leaders-in-training. 
^ Includes 2 teacher leaders and 4 teacher leaders-in-training. 
^Includes 3 teacher leaders and 2 teacher leaders-in-training. 
^Includes 2 teacher leaders and 4 teacher leaders-in-training. 



At the beginning of the year, classroom teachers selected first-grade pupils who appeared to be most 
in need of reading help to perform two reading and writing observational tasks: Concepts About Print and 
Diclalim (see Appendix A, pp. 22-23), which are two of the observational tasks designed by Marie Clay 
(1 979), devetoper of the Reading Recovery program. Scores from these two tasks were used to detemiine 
a pupirs Selection Score. Selection Scores of 77 or betow (see Appendix B, p. 25) qualified pupils for 
Reading Recovery or Early Literacy program service, pupils with the k^west scores being sensed first. The 
typfcal program teacher sensed 27 pupils, three Reading Recovery pupils and 24 Early Literacy pupils, with 
the three Reading Recovery pupils being the pupils with the towest Selectton Scores. After selection for the 
Reading Recovery program, pupils were administered four additional observattonal tasks: Lfittfic 
Identiffcatton . Ohio Word Test. Writing Vocabulary, and Text Reading ipvfti These addittonal 
obsen^atfonal tasks were given to pupils to provkle program teachers with more infonnatton about each 
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pupil before beginning program instaiction. The six observational tasks were also administered at various 
times thftHjghout the school year as pupils entered or exited the program and again at the conclusion of the 
program year. 

Each pupil enrolled for individual sen/ice in the program spent approxirrately the first 10 days 
"Roaming Around the Known." During this period the Reading Recovery teacher built rapport with the pupil 
and provided an opportunity for the pupil to use the strategies he or she already knew in meaningful 
reading and writing activities. Once the Reading Recovery lessons began, a familiar pattem was 
established. A typical 30-minute lesson included most or all of the following activities. 

1 . Two or mpre familiar books from previous lessons were selected by the pupil to be read to the 
teacher. 

2. The teacher took a mnning recoixi whHe the pupil read the book that was introduced to the pupil 
and attempted on the previous day. During this time the Reading Recovery teacher changed the 
focus from instmctton to observation. Meaning, stmcture. and visual cues were analyzed to 
deterrrtne which cues were used or neglected by the pupil. Each day the teacher carefully 
recorded the pupiPs devetopment of reading strategies (e.g.. seff-monitoring, searching for cues, 
cross-checking, setf-conrecting) or ability to deterrnine the nieaning of continuous text. 

3. During letter identifk;ation, plastic letters were used on a nnagnetic board. 

4. The pupil dictated a story and then teamed to write and read it with the teacher's help. 

5. During sound analysis of words from a written story, the pupil was encouraged to say the words 
stowly and write what couW be heard. 

6. A completed story was cut into separate words, whfch were scrambled, and then reanranged in 
the correct order by the pupil. 

7. A new book was introduced by the teacher. 

8. The new book was attempted by the pupil. 

When it was determined by the Reading Recovery teacher, in consultation with the classroom teacher 
and the teacher leader, that a pupil had made sufficient progress to wori< successfully in the nomial 
classroom setting without extra help, the pupil was recommended to be discontinued. Discontinued pupils 
were defined as those who had successfully completed the program according to predetennin(Kl levels on 
the observational tasks and had been released from the program. When pupils left the program (e.g., were 
discontinued. nfX)ved from the school, were placed in special programs), new pupils entered the program 
either from the Eariy Literacy program or from a waiting list. 

Evaluation Design 

For program year 1993-94. three desired outcomes were established for the Reading Recovery 
program. Data collected in four major areas were incorporated in the analyses of the desired outcomes: 
pupil census infomiation, pupil reading strategic processing behavfor informatfon. pupil retainee 
informatton. and pupil independent reading achieverrjent information. Although not part of the evaluatfon 
design, parent involvertient informatfon was also collected by program teachers. 

Desired QijtoQmel! 

At least 50 percent of pupils who received 60 or more lessons or were discontinued will display 
evklence of each strategfc processing behavior at least once during the treatment period when 
reading appropriate instructtonal text to the satisfactton of the program teacher. 

Desired Outnnme 2: 

At least 75 percent of pupils who received 60 or nrx>re lessons or were discontinued will 
denrx>nstrate satisfactory progress in the regular classroom as denfX)nstrated by prorrwtfon to 
grade 2. 
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Desired Qutmmf? r^; 

At least 50 percent of pupils who receive 60 or more lessons or were .^ ncontinued will read at 
least five books at text reading level 8 or above as certified by the program teacher. 

In addition to the desired outcomes, evaluation questions were developed based on two goals 
identified from the 1 984-85 proposal. The goals were: 

1 . To develop and provide the Reading Recovery program for first-grade pupils. 

The individual child who has been identified as being "at risk" of failure has recovered essential 
reading strategies and can function satisfactorily in the regular classroom. 

2. To adapt and apply the necessary inservice program for teachers. 

To implement the Reading Recovery techniques, teachers will receive intensive twining over the 
period of a year while sinujltaneously implementing the program with chiWren through clinical and 
peer-critiquing experiences guided by a skilled instructor. 

Based on these two goals, three evaluation questions regarding the 1993*94 Reading Recovery 
program were devetoped. The questions focused on the following areas: service pattems, posttest 
perfomfiance on a standardized test of reading, and long-temi effects of the program. The specific 
evaluation questions and analyses for each are listed below. 

Question 1 What were the service pattems of pupils in the Reading Recovery program? 
Analysis 1 .1 Number of pupils who were served. 
Analysis 1 .2 Number of pupils who were discontinued. 
Analysis 1 .3 Demographic characteristics of pupils who were served. 
Analysis 1 .4 Demographic characteristics of pupils who were discontinued. 

Question 2 What were the perfonnance levels of Reading Recovery pupils on a standardized test 
of reading? 

Analysis 2. 1 Number and percent of pupils reaching the 50%ile in Total Reading on the MAT6. 

Analysis 2.2 Number and percent of pupils reaching the 37%ile in Total Reading on the MAT6. 

Analysis 2.3 Number and percent of pupils reaching the average NCE for the district in Total 
Reading on the MAT6. 

Analysis 2.4 Analysis of central tendency and distribution of NCE scores of Total Readina on 
the MAT6. 

Question 3 What were the tong-temi effects of the Reading Recovery program? 

Analysis 3.1 Number and percent of pupils in the 1991-92 and 1992-93 Reading Recovery 
treatment groups who in 1993-94 attended a school where a compensatory 
program was available and who were served by a compensatory program. 

Analysis 3.2 Number and percent of pupils in the 1991-92, 1992-93. and 1993-94 Reading 
Recovery treatment groups who followed a nonnal grade level progression. 
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Instruments 

The evaluation design pfovided for the collection of data in the following six areas of operation for the 
overall program. Included in the collection of data was parent invoh/ement infomiation, which was not part 
of the evaluation design. 

1 . Teacher Census Infonmation 

Teacher Census Forni (TCF) was completed by program teachers to obtain staffing infomiation. 
including employment status, periods of program instaiction. and school assignment (see 
Appendix C. p. 27). 

2. Pupil Census Information 

Calendar Worksheet/Par ent Invofvement Log (CW/PIL) was used to record pupil service 
infomnation, Selection Scores, and parent involvement data (see Appendix D, pp. 29-30). 

Pupil Roster was completed by program teachers to indicate official enrollment of each pupil into 
the program. Program teachers identified pupils served from computer generated lists of all first 
grade pupils in their buildings. Infomiation included pupil name, student number, date of birth, 
program teacher name, school code, and program code. 

Pupil Data Sheet (PDS) was a computer generated preprinted fonm used by program teachers to 
summarize enrollment/attendance data. nun4)er of lessons, reading strategic processing 
behavior information, independent reading achievement infomiation. parent involvement, 
discontinued status, hours of instmction per week. English-speaking status, and progress made 
for each pupil served (see Appendix G, pp. 36-37). 

3. Pupil Reading Strategic Processing Behavior Infomiation 

Evklence of Strategic Pr ocessing Collection Form was used by program teachers throughout the 
year to record student behaviors whfch display strategy processir)g (see Appendix E, p. 32). 

Pupil Data Sheet (PDS), described earlier, was a computer generated preprinted fonm used by 
program teachers to summarize reading strategte processing behavk)r information for each pupfl 
sen/ed (see Appendix G, pp. 36-37). 

4. Retentton Informatfon 

District corrputer files were utilized to access retention data. 

5. Pupil Independent Reading Achievement/Pupil Standardized Achievement Test Informatton 

Independent Reading Record Sheet was used by program teachers throughout the year to record 
the successful reading experiences of program pupils (see Appendix F, p. 34). 

Pupil Data Sheet (PDS), described eariier, was a computer generated preprinted fomi used by 
program teachers to summarize irxlependent reading achievement information for each pupil 
sensed (see Appendix G, pp. 36-37). 

The Metropolitan Achievement Tests (MAT6, 1985) was used to obtain standardized 
achievement test informatton for all pupils in the Reading Recovery program. Results from the 
test were used as pretesi scbres for pupils in grade 2. This test series has empirical nomis for 
spring, established April 8 to May 15, 1985. The descriptk)n of the MAT6 is as follows: 



Level Form Recommfind^d firadP Ranqp SllhlfiSla Nuniiernf Wf^.m^ 

Primer L K.5-1.9 Vocabulary 15 

Word Recognition Skills 36 
Reading Comprehension 3fl 
Total Reading 89 



The MAT6 tests were administered by classroom and program teachers. Testing occun-ed March 
21-24. 1994. All testing was done on level, as indicated in the table above. 
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6. Parent Involvement Infonration 

Parent lnvQtver7>ent Log (PIL) was used to record parent involvement data, including the date, 
type of activity/invotvement. and nanie of attendee(s) (see Appendix D» p. 30). 

Pupil Data Sheet (PDS). described eariier, was a computer generated preprinted form used by 
program teachers to summarize data collected from the Parent Invotvement Logs for each pupil 
sensed (see Appendix G, pp. 36-37). 

Insen^ice evaluation infonrotion, data which were not specified in the Reading Recovery evaluation 
design but were collected routinely, is not included here but has been submitted to the Departnf)ent of 
Federal and State Programs, Columbus Public Schools. Reports are available upon request. 



Mapr Rndings 

Pupils Serve d/Desired Outcomes 

During the 1993-94 school year, a total of 402 pupils were served by the Reading Recovery program. 
The treatment group for 1993-94 was limited to the 105 pupils who were discontinued and the 40 additional 
pupils who had a minimum of 60 lessons but were not discontinued (a total of 145 pupils or 36.1% of all 
pupi!s served). The use of the 60 lesson distinction was based on the premise in Marie Cla/s research in 
Nev^ Zealand (1979) which detem^ined that an average of 60 lessons was needed for pupils to be 
dfccontinued and to continue to work successfully in the nonral classroom setting. Thus, the 257 other 
pupils served were excluded from the treatment group. The evaluation sample used for evaluation of 
'Standardized achievement test perfomiance was restricted to those pupils who were in the treatnf>ent group, 
were English-speaking, and had a valid MAT6 Total Reading score from the spring administration of the 
standardized achievement test. Of the 145 pupils in the treatment group, 8 pupils were excluded from the 
evaluation sample because of incomplete test data. The evaluation sample was comprised of the 
remaining 137 pupils, which was 94.5% of the treatment group and 34.1% of the 402 pupils sensed. 

Desired Outcome 1: 

At least 50 percent of pupils who received 60 or more lessons or were discontinued will display 
evidence of each strategic processing behavior at least once during the instmctional period when reading 
appropriate instmctional text to the satisfaction of the program teacher. 

Desired Outcome 1 was based on the nunnber of pupils who were discontinued from the Reading 
Recovery program or who received 60 or more lessons during the school year. A total of 145 pupils vneX 
one of these criteria. Of these 145 pupils, 135 (93.1%) displayed each of the three strategic processing 
behaviors (monitors reading, constructs meaning, integrates sources of infonfnation), thus allowing Desired 
Outcome 1 to be met. 

Desired Outcome 2: 

At least 75 percent of pupils who received 60 or more lessons or were discontinued will demonstrate 
satisfactory progress in the regular classroom as denx)nstrated by pronfX)tion to grade 2. 

Desired Outcome 2 was also based on the number of pupils who were discontinued from the Reading 
Recovery program or who had received 60 or wore lessons during the school year. A total of 145 pupils 
met one of these criteria. Of these 145 pupils, retention data were available for 142 pupils. Of these 142 
pupils. 139 (97.9%) were not retained. Ttxjs, Desired Outcome 2 was met. 
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Desired Outcome 3; 

At least 50 percent of pupils who receive 60 or more lessons or were discontinued will read at least 
five books at text reading level 8 or above as certified oy the program teacher. 

Desired Outcome 3 was also based on the number of pupils who were discontinued from the Reading 
Recovery program or who had received 60 or more lessons during the school year. Of the 145 pupils who 
a\e\ one of these criteria. 138 (95.2%) read at least five books at text reading level 8 or above, thus altowing 
Desired Outcome 3 to be met. 

Parent Involvement 

Records of parent contacts and activities were maintained by program teachers using the Parent 
Involvement Log {Appendix D. p. 30) to docunient the date of parent contact, the type of activity, and which 
parents or guardians participated in each activity. Table 2 displays parent involvement data collected by 
program teachers on the Parent Involvement Log for each of the 402 pupils sensed in the program. The 
data indicate that a total of 434 different parents or guardians were involved in some way with the program 
and that program teachers made 1 105 contacts with these 434 individuals. It shouW be noted that the total 
number of parents involved is not additive, as a parent could be involved in nrwe than one activity for the 
year. The majority of contacts (78.2%) with parents or guardians was through indivkJual parent 
conferences (864 contacts). The smallest number of contacts with parents or guardians involved planning, 
operating, and/or evaluating the program, >¥ith 18 contacts (1.6% of all contacts made). Table 2 also 
displays parent involvement data for the parents of the 145 treatment group pupils. The 145 treatment 
group pupils represented 36.1% of the 402 pupils sen/ed, but represented 51.0% (563) of the total number 
of contacts made for the year and 41.7% (181) of the indivkJual parents involved in the program. Similar to 
parent involvement for alt pupils sen/ed, the majority (75.1%) of the parent contacts for treatment group 
pupils was with indivkJual conferences (423 contacts). The smallest nurrtber of contacts with parents or 
guardians of treatment group pupils also involved planning, operating, and/or evaluating the program, with 
1 4 contacts (2.5% of all contacts made). 

Program teachers also maintained records, using the Parent Involvement Log, if parents helped their 
chiW with homework and if the parents read to their chiW or the chiW read to the parents. Of the 402 pupils 
sensed. 87.3% (351) had parents who helped with homework and 89.6% (360) either read to their parents 
or had their parents read to them. For the 1 45 treatment group pupils, 93.8% (1 36) had parents who helped 
wrth homework and 94.5% (137) either read to their parents or had their parents read to them. 

Evaluatfon Questions 

Qu£SltoO-L What were the sen/ice patterns of pupils in the Reading Recovery program? 
Analysis 1 .1 Number of pupils who were sensed. 
Analysis 1 .2 Number of pupils who were discontinued. 
Analysis 1 .3 Demographfc characteristtes of pupils who were served. 
Analysis 1 .4 Denx)graphic characteristkjs of pupils who were discontinued. 

The servfce patterns of the Reading Recovery program are reported betow in the foltowing order: the 
number of pupils who were served and their demographic characteristics; the number of lessons received; 
and the number of pupils who were discontinued and their demography characteristics. 

The 1993-94 Reading Recovery program sen/ed a total of 402 first^rade pupils in 38 schools (see 
Table 1, page 2). During 1992-93, 305 pupils were sen/ed in 60 schools, an increase in pupils sen/ed of 
approximately 31.8% (97 pupils) for school year 1993-94. This increase in pupils sen/ed resulted in part 
from an increase in program teachers from 16.5 PTEs to 22.0 PTEs, a 33.3% increase in teaching staff. 
Reading Recovery pupils received 30-n^'nute tessons daily, for an average of 2.5 hours of instruction per 
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Table 2 



Number of Parents 
Reported for Parent Invotvenrient Activities for 
Reading Recovery Program 
1993-94 



Totals for Year 



Program Activities 


Treatment 
Group Pupils* 
(N=145) 


All Pupils 
Served 
(N=402) 


1 . Parents involved in the planning, operation 
a»Kl/or evaluation of your unit 
Number of Parents 
Number of Contacts 


10 
14 


13 
18 


. 2. Group meetings for parents 
rsiurnoeroT rarems 
Number of Contacts 


33 
42 


58 
71 


3. Individual parent conferences 
Number of Parents 
Number Of Contacts 


1/4 

423 


413 
864 


4. Parental classroom visits or field trips 
Number of Parents 
Number of Contacts 


53 
72 


95 
126 


5. Visits by teacher to parents* homes 
Number of Parents 
Number of Contacts 


9 

12 


22 
26 


Total Parents Contacted^ 
Total Number of Contacts 


181 

563 


43-* 
1105 


® Treatment Group Pupils are those who were discontinued from the program or had 60 or more 
lessons. 

^ Total Parents Contacted is based on an unduplicated count of parents contacted, which is less 
than the sum obtained when combining the Number of Parents for Activities 1-5. 
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The demographic characteristics (gender, race, arxl socio-economic status) of the 402 pupils who 
were served in the program were analyzed from the school districTs Student Master File (SMF), Pupil 
Infomiation Re (PIF). and November 1993 official enrolln^ent tape. The data were based on information 
reported by parents and/or school personnel. Of the pupils sensed, 60.7% (244) were boys and 39.3% 
(158) were girts (see Table 3). As for the distnlxjtion by race, 42.0% (169) of the pupils served were 
identified as Non-Minority, 56.0% (225) were Black, and the remaining 2.0% (8) were Other Minority (see 
Table 4). The Other Minority category included Spanish Sumame, Asian American, and American Indian. 
Socio-economic status was indicated by pupi! eligibility for subsidized (free or reduced price) lunch as of 
June 1994. Of the 402 pupils sen/ed, 88.3% (355) were on free lunch, 2.5% (10) were on reduced price 
lunch, and 9.2% (37) were not on subsidized lunch (see Table 5). 

For evaluation purposes, tho pupils served in the program were divided into three categories: 
discontinued pupils (those who had successfully completed the program); not discontinued pupils who had 
received 60 or more lessons; and other pupils served (those who were not discontinued and who received 
fewer than 60 lessons), a tho 402 pupils served during 1993-94. 26.1% (105) were discontinued, 10.0% 
(40) were not discontinued but receK'ed 60 or more lessons, and 63.9% (257) were other pupils sensed 
(see Table 9). For 1992-93. program data revealed that 26.9% of pupils were discontinued. 26.2% were 
not discontinued but received 60 or more lessons, and 46.9% were other pupils served. The data show 
that the percent of pupils who received 60 or more lessons but were not discontinued decreased and that 
the percent of other pupils served increased. When looking at only treatment group pupils (those who were 
discontinued or had 60 lessons or more), data show that 72.4% (105 out of 145 pupils) were discontinued 
during 1993-94. During 1992-93, there were 162 treatment group pupils, with 82 (50.6%) being 
discontinued, an increase of over 20 percent from the 1 992-93 to 1 993-94 school year. 

Enrollrrient data indicate that for 1993-94, average pupil enrollment was 62.0 days, compared to 
average pupii enrollment of 76.7 days in 1992-S3. The average pupil attendance was 53.8 days in 1993- 
94. compared to 66.7 days for 1992-93. The number of lessons corrpleted by pupils ranged from none to 
114. with an average of 42.9 lessons, compared to an average of 55.2 lessons in 1 992-93. It was possible 
for a pupil to be enrolled in the program and receive no lessons. During the first 10 days of program 
attendance, pupils are "Roaming Around the Known." These 10 days count as days of eniollment and 
attendance, but not as days of lessons. During 1993-94, 15 pupils were enrolled and attended the 
program, but withdrew before they coukJ begin lessons, and therefore had no lessons recorded. The 
number of lessons completed by pupils who were discontinued ranged from 6 to 1 10, with an average of 
58.8 lessons. The number of lessons completed by pupils who were not discontinued (the two other pupil 
categories combined) ranged from none to 1 1 4 lessons, with an average of 37.3 lessons. Of the 98 pupils 
who received 60 or more lessons, 59.2% (58) were discontinued and 40.8% (40) were not discontinued. A 
distribution of the number of lessons completed by pupils in the three pupil categories is shown in Table 9. 
During 1 993-94. the average number of pupils served by each teacher (22.0 PTEs) was 1 8.3 pupils and the 
average number of pupils discontinued by each teacher was 4.8 pupils, compared with 18.5 pupils served 
and 5.0 pupils discontinued by each teacher in 1992-93. 

An examination of the 105 pupils who were discontinued from the program revealed that 66.7% (70) of 
the discontinued pupils were boys, while 60.7% (244) of the total pupils served were boys and that 33.3% 
(35) of discontinued pupils were girts, while 39.3% (1 58) of all pupils served were giris (see Tables 3 and 6). 
Of the 244 boys served, 28.7% were discontinued and of the 158 giris served. 22.2% were discontinued. 
The analysis by race indicated that 50.5% (53) of the discontinued pupils were Black, conpared with 56.0% 
Black pupils for all pupils served. Non-minorities made up 45.7% (48) of discontinued pupils and Other 
Minorities 3.8% (4) of discontinued pupils (see Tables 4 and 7). Of the 105 discontinued pupils. 81 -9% (86) 
were on free lunch, 1 .9% (2) were on reduced lunch, and 1 6.2% (1 7) were not on subsWized kjnch. When 
comparing these figures to all pupils served, smaller percentages of discontinued pupils were on free or 
reduced price lunch and a higher percentage of discontinued pupils were not on subsidized lunch (see 
Tables 5 and 8). 

Question 2 What were the perfomrtance levels of Reading Recovery pupils on a standardized test 
of reading? 

Analysis 2.1 Number and percent of pupils reaching the 50%ile in Total Reading on the (vtATC. 
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(402) 




60.7 


39.3 


100.0 
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Boys 


Girts 
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Tables 



Percent and Number of Reading Recovery Pupils 
Served by Pupil Category and Nurriber of Lessons 
1993-94 



Pupil Category 

Not Other Total 

Nun*erof Discontinued Discontinued Pupils Pupils 

Lessons Pupils® Pupils*^ Served^ Served 





% 




% 


n 


% 


n 


% 


li 


F^wpr thAn 60 


















0-9 


' 1.9 


(2) 






14.0 


(36) 


9.5 


(38) 


10-19 


3.8 


(4) 






10.9 


(28) 


8.0 


(32) 


20-29 


5.7 


(6) 






17.1 


(44) 


12.4 


(50) 


30-39 


9.5 


(10) 






21.0 


(54) 


15.9 


(64) 


40-49 


12.4 


(13) 






28.4 


(73) 


21.4 


(86) 


50-59 


11.4 


(12) 






8.6 


(22) 


8.5 


(34) 


Subtotal 


44.8 


(47) 






100.0 


(257) 


75.6 


(304) 


60 or More 


















60-69 


23.8 


(25) 


42.5 


(17) 






10.5 


(42) 


70-79 


15.2 


(16) 


20.0 


(8) 






6.0 


(24) 


80-89 


5.7 


(6) 


12.5 


(5) 






2.7 


(11) 


90-99 


7.6 


(8) 


15.0 


(6) 






3.5 


(14) 


100-109 


1.9 


(2) 


7.5 


(3) 






1.2 


(5) 


110-119 


1.0 


(1) 


2.5 


(1) 






0.5 


(2) 


Subtotal 


55.2 


(58) 


100.0 


(40) 






24.4 


(98) 


Total 


100.0 


(105) 


100.0 


(40) 


100.0 


(257) 


100.0 


(402) 



* Discontinued pupils could have any number of lessons 
^ Not discontinued pupils with 60 or more lessons 
^ Other pupils served with fewer than 60 lessons 
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Analysis 2,2 Number arxl percent of pupils reaching the 37%ile in Total Reading on the MAT6. 

Analysis 2.3 Number and percent of pupils reaching the average NCE for the district in Total 
Reading on the MAT6. 

Analysis 2.4 Analysis of central tendency and distribution of NCE scores of Total Reading on 
theMAT6. 

MAT6 test scores from spring 1994 were analyzed for the 137 pupils in the evaluation sample and for 
certain subgroups within the evaluation sample (see Tables 10 and 1 1). Table 10 presents data showing 
the number and percent of pupils reaching the 37%ile and 50%ile in Total Reading on the MAT6 spring 
testing. Of the 137 pupils in the evaluation sample. 19.0% (26) reached the 37%ile on the test, with 13,9% 
(19) reaching the 50%ile on the test. The remaining 1 1 1 pupils (81 .0%) in the evaluation sanple had test 
scores below the 37%ile. indicating that they were still Eligible for Chapter 1 program sen/ice. Those pupils 
who were successfully discontinued from the program reached the 37%ile and 50%ile on the test at much 
higher percentages than did those pupils who were not discontinued and received 60 or more lessons. Of 
the 97 discontinued pupils. 25.8% (25) reached the 37%ile and 18.6% (18) reached the 50%ile. but only 
2.5% (1) of the 40 not discontinued ptpils who received 60 or more lessons reached the 37%ile and 
50%ile. 

When comparing the percents of pupils reaching the 37%ile and 50%ile in Total Reading on spring 
testing over the eight year period from 1 987 to 1 994. the data reported in Table 1 1 show that from the 1 992- 
93 to 1993-94 school year there was a decrease in the perxjent of pupils reaching the 37%ile (23.1% to 
19.0%) and a decrease in the perx>ent of pupils reaching the 50%ile (17.9% to 13.9%). The data also 
indicate that when the test was changed from the CTBS, 1981, to the MAT6. 1985, beginning with the 
1988-89 school year, test scores dropped. The decrease, in part, resulted from the MAT6, 1985, being 
considered to be a more difficult test than the CTBS, 1981 . Research indicates that tests normed in 1985 
would be more difficult than those normed in 1981 because reading scores nationwide rose over the period 
from 1981-1985. Another possible explanation for the dramatic decrease in 1988-89 may be attributed to 
the inappropriateness of the pretest level of the MAT6, 1985, administered at that time. Ihe MAT6 results 
may not have reflected true pupil performance during 1988-89. The pretest level was found to be too 
difficult for low-achieving pupils, while the postlest level was found to be too easy for the average and 
above-average pupils. More appropriate pretest and posttest levels were administered in 1989-90 and 
thereafter. The increases in the percents of pupils reaching the 37%ile and 50%ile in Total Reading during 
1990-91 and 1991-92 can, in part, be attributed to the selection process for pupils into the program. Prior to 
1990-91, pupils scoring the lowest on the selection test were served by the Reading Recovery program. 
But in 1 990-9 1 , with the establishment of the Eariy Literacy program, the lowest pupils were sensed in Eariy 
Literacy and not Reading Recovery. Also, many pupils entered the Reading Recovery program after 
having been served in the Eariy Literacy program, resulting in pupils entering the Reading Recovery 
program with higher reading skills and strategies. Bui again in 1992-93 and 1993-94 the lowest pupils were 
served in Reading Recovery and not Early Literacy. This, in part, may attribute to the decrease in the 
percents of pupils reaching the 37%ile and 50%ile in Total Reading from the 1991-92 school year to the 
1992-93 school year, and again from 1992-93 to 1993-94. 

The data derived from Analysis 2.3, relating to the number and percent of pupils reaching the average 
NCE for the district in Total Reading on the MAT6, show that of the 137 pupils in the evaluation sanple, 26 
(19.0%) reached the average NCE (42.2 NCEs) for the district in Total Reading. Of the 97 pupils in the 
evaluation sample who were successfully discontinued. 25 (25.8%) reached the district average, while only 
one (2.5%) of the evaluation sample pupils who was not discontinued and received 60 or more lessons (40) 
reached the district average NCE for the postlest. 

For analysis 2.4 the Shapiro-Wilk W Test was run to determine whether or not the distribution of the 
Total Reading scores was relatively nonnat. Results indicated the distributfon of 137 scores did differ 
signifkxantly from a normal distribution, suggesting that the scores were not nonnally distributed at 
postlesting. Further examinatkxi of the data revealed that the distributton was slightly different from a 
nonnal distributfon; however, the mean was not substantially higher than the median and no significant 
number of students scored betow the guess level. Thus, the Shapiro-Wilk W Test, a very powerful test 
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Table 10 

Percent arxl Number of Evaluation Sample Pupils 
Reaching 37%ile and 50%ile on MAT6 
Total Reading by Pupil Category 
1993-94 



Total Reading 





Pupil 






37%ile 




50%ile 












a 


% 




a 


% 




a 




Discontinued 




97 


25.8 




25 


18.6 




18 




Not Discontinued and 
60 or More Lessons 


40 


2.5 




1 


2.5 




1 




Total Sample 




137 


'19.0 




26 


13.9 




19 








Table 1 1 

Percent and Number of Evaluation Sample Pupils 
Reaching 37%ile and 50%ile on MAT6 
Total Reading by Year 
1987-94 






















Total Reading 






School 










37%ile 




50%ite 




Year 




K 


lest 




% 


a 




% 




a 


1986-87 




189 


CTBS.1981 




38.6 


73 




18.5 




35 


1987-88 




253 


CTBS. 1981 




33.2 


84 




15.0 




38 


1988-89 




104 


MAT6. 1985 




22.1 


23 




11.5 




12 


1989-90 




184 


MAT6. 1985 




22.8 


42 




15.2 




28 


1990-91 




139 


MAT6. 1985 




37.4 


52 




23.7 




33 


1991-92 




111 


MAT6. 1985 




51.4 


57 




35.1 




39 


1992-93 




156 


MAT6, 1985 




23.1 


36 




17.9 




28 


1993-94 




137 


MAT6. 1985 




19.0 


26 




13.9 




19 
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(Shapiro. Wilk, and Chen, 1968) when testing for departures from nonnality, indicates there were 
departures from nomiality, however, the additional analyses reveal that these departures are not great 
enough for concern. 

Question 3 What were the long-term effects of the Reading Recovery program? 

Analysis 3.1 Number and percent of pupils in the 1991-92 and 1992-93 Reading Recovery 
treatment groups who in 1993-94 attended a school where a compensatory 
program was available and who were served by a compensatory program. 

Analysis 3.2 NurTi>er and percent of pupils in the 1991-92, 1992-93, and 1993-94 Reading 
Recovery treatment groups who followed a nornial grade level progression. 

Analysis 3.1 and 3.2 were conducted from available follow-up data for pupils who were in the 1 991 -92, 

1992- 93. and 1993-94 treatment groups. The original 1991-92 treatment group was comprised of 117 
pupils, the 1992-93 treatment group was comprised of 162 pupils, and the 1993-94 treatment group was 
comprised of 145 pupils. The number of pupils included in the analyses for Question 3 varied due, in part, 
to pupil mobility, the timing of data collection, and different restrictions inherent in the various analyses. 

Table 12 contains a summary of results for Analysis 3.1, the study of the 1991-92 and 1992-93 
Reading Recovery treatment group pupils who were served by a compensatory program in 1993-94. The 
analysis included three conpensatory programs: the Chapter 1 Reading program, the Eariy Literacy 
program, and the Reading Recovery program. Pupils who were on a waiting list to be served by a 
compensatory education program were not included in Analysis 3.1 . The criterion scores used to establish 
eligibility for program service varied from program to program. Availability of service depended on the 
number of pupils qualifying for sen/ice at a particular building and the number of compensatory education 
teachers assigned to that building. 

Of the 117 pupils in the 1991-92 Reading Recovery treatment group, 107 pupils were in a school and 
at a grade level where a compensatory program was in operation during the 1993-94 school year (see 
Table 12). Of these 107 pupils, 34.6% (37) were served in a compensatory program. By grade level. 
80.0% (4) of the five pupils in grade 2 were served, compared to 32.4% (33) of the 102 pupils in grade 3. 
For the 1991-92 treatment group, the percent of discontinued and not discontinued pupils served by a 
compensatory program varied. In grade 2. no discontinued pupils were served in a compensatory program 
compared to 80.0% (4) of the five not discontinued pupils. In grade 3. 13.0% (9) of the 69 discontinued 
pupils were sen/ed in a compensatory program compared to 72.7% (24) of the 33 not discontinued pupils. 

Of the 162 pupils in the 1992-93 Reading Recovery treatment group, 150 pupils were in a school and 
at a grade level where a conpensatory program was in operation during the 1993^94 school year (see 
Table 12). Of these 150 pupils, 42.7% (64) were served in a compensatory education program. By grade 
level, four (28.6%) of the 14 pupils in grade 1 was served, compared to 44.1% (60) of the 136 pupils in 
grade 2. In grade 2, 28.6% (22) of the 77 discontinued pupils were served compared to 64.4% (38) of the 
59 not discontinued pupils. 

Table 13 summarizes results for Analysis 3.2, the distnTxittons of pupils in the 1991-92, 1992-93, and 

1993- 94 Reading Recovery treatment groups who followed a nonnal grade-level progression. Only pupils 
who were enrolled in the Columbus Public Schools during the nx^nth of November in all of their follow-up 
years (1992, 1993, and/or 1994) were included in the analysis. JYiO mwbers of pupils included from the 
three treatment groups were: 97 pupils (82.9%) from the 1991-92 treatment group, 131 pupils (80.9%) from 
the 1992-93 treatment group, and 134 pupils (92.4%) from the 1993-94 treatment group, for a cdrtibined 
total of 362 pupils (85.4%) from the three treatment groups. 

The percentages of pupils who followed a normal grade-level progression were as follows: 88.7% (86) 
oi the 97 pupils from the 1 991-92 treatment group followed a nonnal grade-level progression into the fourth 
grade; 82.4% (108) of the 131 pupils from the 1992-93 treatment group followed a normal 
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Table 13 

Percent arxl Number of Pupils in the 1991-92, 1992-93, and 1993-94 
Reading Recovery Treatment Groups by Grade-Level 
Progression Through November 1994 



Grade-Level Progression 



Not Nonnal 



Nonmal 



Total 



Treatment Group 




a 


ft/ 


n 


A/ 


N. 


1991-92 














Discontinued 


3.2 


(2) 


96.8 


(61) 


100.0 


(63) 


Not Discontinued 


26.5 


(9) 


73.5 


(25) 


100.0 


(34) 


ouDtotai 


1 1.3 


(11) 


00.7 


(86) 


100.0 


(97) 


1992-93 














utscontinueo 


b.d 


(4) 


93.8 


(60) 


100.0 


(64) 


Not Discontinued 


28.4 


(19) 


71.6 


(48) 


100.0 


(67) 


Subtotal 


17.6 


(23) 


82.4 


(108) 


100.0 


(131) 


1993-94 














Discontinued 


1.0 


(1) 


99.0 


(96) 


100.0 


(97) 


Not Discontinued 


10.8 


(4) 


89.2 


(33) 


100.0 


(37) 


Subtotal 


3.7 


(5) 


96.3 


(129) 


100.0 


(134) 


Total 














Discontinued 


3.1 


(7) 


96.9 


(217) 


100.0 


(224) 


Not Discontinued 


23.2 


(32) 


76.8 


(106) 


100.0 


(138) 


Subtotal 


10.8 


(39) 


89.2 


(323) 


100.0 


(362) 



Note. The 1 99 1 -92 treatment group was followed for 3 years (nomial progression into grade 4), 
the 1992-93 treatment group for 2 years (normal progression into grade 3), and the 1993- 
94 treatment group for 1 year (nornial progression into grade 2). Only pupils enrolled in 
the Columbus Pubfic Schools during November in each of their follow-up years were 
included in the analysis. 
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pfogresskKi into the third grade; and 96.3% (129) (A the 134 pupas from the 1993-94 treatment group 
fotiowed a normal grade-level progression into the second grade in 1994-95. Overall. 89.2% (323) of the 
362 pupils in the analysis followed a nonnal grade-level progression and 10.8% (39) did not. 

In each of the three treatment groups a greater percentage of discontinued pupils than not 
discontinued pupils followed the normal progression. F6r discontinued pupils, the percentages who 
followed the normal progression ranged from 93.8% for the 1 992-93 treatment group pupils to 99.0% for the 
1993-94 treatment group pupils. For not discontinued pupils the percentages who followed a normal 
progression ranged from 71 .6% for the 1992-93 treatment group pupils to 89^ for the 1993-94 treatment 
group pupils. 

Over the three year period 1991-92, 1992-93, 1993-94. data indicated that the percentage of treatment 
group pupils retained in grade 1 had decreased, then increased, and then decreased again. For 1991-92. 
data were available for 1 17 pupils and showed 1 .7% (2) of those served in 1991-92 had been retained in 
grade 1. In 1992-93, 8.1% (13) of the 160 treatment group pupils were retained in grade 1. For 1993-94. 
2.1% (3) of the 1 42 pupils with available retention data were retained in grade 1 , while 4.3% (18) of the 419 
pupils in the three groups combined had been retained in grade 1 . 



Summary/Recommendations 

In 1 993-94 the Reading Recovery program was located in 38 elementary schools and had a staff of 61 
teachers (22.0 PTEs). For evaluatton purposes, the program started on September 20. 1993 and continued 
through May 13, 1994. The program sen/ed a total of 402 underachieving first^rade pupils who appeared 
unlikely to read successfully without intensive instruction. These 402 pupils were enrolled in the program 
for an average of 62.0 days, attended the program an average of 53.8 days, and received an average of 
42.9 lessons. The number of lessons received ranged from none to 1 14. 

Pupils were discontinued from the program based on scores on diagnostic measures indicating that 
they were reading at the level of their classroom and based on teacher judgment that the pupils had 
developed effective reading strategies. Of the 402 pupils sen/ed. 26.1% (105) were discontinued. 10.0% 
(40) received 60 or more lessons but were not discontinued, and 63.9% (257) were not discontinued and 
received less than 60 lessons. Of the 98 pupils who received 60 or more lessons, 59.2% (58) were 
discontinued. 

The treatment group consisted of the 145 pupils who were either discontinued (105) or received 60 or 
more lessons but not discontinued (40). The evaluation sample consisted of the 137 pupils who were 
discontinued or had 60 or nrwre lessons, were English-speaking, and iiad a valid Total Reading score on 
the MAT6 spring test. The three desired outcon>es for the 1993-94 Reading Recovery program were met. 
Of the 145 treatment group pupils. 135 (93.1%) displayed over time each of the three reading strategic 
processing behaviors, including monitoring reading, constaicting meaning, and integrating sources of 
infomiatton (criterion was 50.0%). Of the 145 pupils in the treatnwnt group, retention data were available 
for 142 pupils. Of these 142 pupils. 139 (97.9%) were not retained (criterion was 75.0%). Of the 145 
treatment group pupils. 138 (95.2%) read five or more books at text reading level 8 or above (criterion was 
50.0%). 

Records of parent contacts and activities maintained by program teachers for the 402 pupils served 
indicated 434 different parents or guardians were involved in some way with the program. These 434 
indivWuals made a total of 1105 contacts with program teachers. The 145 treatment group pupils 
represented 36.1% of the 402 pupils sen/ed. but their parents represented 51 .0% (563) of the total number 
of contacts and 41.7% (181) of the individual parents involved in the program. 

Twenty-six (19.0%) of the evaluation sample pupils reached the average NCE (42.2) for the district as 
a whole. The percentages of pupils who were at various percentile levels on the spring test were as 
foltows: (a) 13.9% (19) were at the 50%ile or above (grade level); and (b) 81.0% (1 1 1) were below the 
37%ile and still eligible for Chapter 1 sen/ices. 
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Analyses of the long-term effects of Reading Recovery produced the following results. Of the former 
Reading Recovery pupils who were in a school and at a grade level where a compensatoiy education 
program was in operation in 1993-94, 34.6% (37) of the pupils ffx>m the 1991-92 treatment group and 42.7% 
(64) of the pupils from the 1992-93 treatment grcxip were sensed in a compensatory program. 

Of the 362 pupils from ihe combined 1991-92. 1992-93, and 1993-94 treatment groups who remained 
in Columbus Public Schools through November 1994, 89.2% (323) followed a normal grade-level 
progression. The retention rates for grade 1 were: 17% for the 1991-92 treatment group, 8.1% for the 
1992-93 treatment group, 2.1% for the 1993-94 treatment group, and 4.3% for the three treatment groups 
combined. 

The Reading Recovery program has been continued during the 1994-95 school year, and it is 
recommended that it continue. With that in mind, the following recommendations are presented: 

1. The process by which pupils with less than 60 lessons are transferred from the Reading Recovery 
program to the Early Literacy program needs to be closely monitored. From 1992-93 to 1993-94, 
the percent of treatment group pupils decreased from 53.1% (162 of 305 pupils sen/ed) to 36.1% 
(145 of 402 pupils sen/ed). The decrease in treatment group size is directly related to transferring 
pupils from Reading Recovery to Early Literacy l>efore the pupils received 60 lessons, which is the 
number of lessons needed to be included in the trealrDenI grxxjp. If pupils are making progress in 
literacy acquisition, program teachers should make every effort to continue to sen/e them beyond 
60 lessons. 

2. Efforts shouW continue for exptoring ways to minimize the amount of time needed to collect data on 
pupils served. Much teacher frustratfon exists because of the volume of record keeping required 
for the program. Teachers maintain records for both Columbus Public Schools and Ttie Ohio State 
University College of Education. If both institutions used the same set of data, reporting by both 
institutfons would be consistent and the amount of paperwork required of teachers reduced. 

3. As increased parent involvement is regarded as one of the indicators of effective schools, every 
effort must be undertaken to promote parental involvement in the program, especially in the areas 
of planning, operation, and evaluation. 

4. The earliest possible identification of pupils needing special educalion instmction should be 
emphasized. Pupils with special needs can be better sen/ed by teachers with expertise in specific 
special educalion areas. Reading Recovery is not a special educatfon program. If pupils with 
special educalion are not Wentified early, they remain in the Reading Recovery program too tong, 
creating frustration for both pupils and teachers. 

5. The whole language instructfonal strategies and techniques used by program teachers need to be 
shared with and enhanced by the regular classroom teacher. The instruction provided by the 
program teacher and by the regular classroom teacher nxjist complement each other. The 
academic achievement of pupils will suffer if they receive mixed messages in their reading and 
writing instruction. Opportunities must be made available for program teachers and regular 
classroom teachers to devetop a consistent whole language based approach to instruction. 

6. Insen/ice meetings should be continued to provkle program teachers tho opportunity to enhance 
their instructional inten/enlion skills, to share instnjctional Weas with one another, and to clarify any 
concems or misconceptions they may have about the total Reading Recovery program. 

7. An on-going process of site visitatfons by the t^rogram evaluator needs to be continued. These 
visits provide invaluable infonnation for the program evaluator in the areas of content and 
instnjction and provide program teachers the opportunity to clarify questions they n^ay have about 
evaluation requirements and record keeping. These visitations also help build a rapport between 
tho program teacher and program evaluatot . 
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CONCEPTS ABOUT PRINT SCORING SHEET 
. Stones: Sand: TEST SCORE 



22 



School Name: 



Classroom Teacher 



Use the script when administering this test 



PAGE 



Cover 



2/3 



4/5 



8/9 



10/11 



12/13 



14/15 



16/17 



18/19 



20 



SCORE 



ERIC 
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ITEM 



1. Front o( book 



2. Print contains message 



3. Where to start 

4. Which way to go 

5. Return sweep to left 

6. Wofd by word matching 



7. Rrst arxJ last concept 



8. Bottom of picture 



9. Begin The' (Sand) or T (Stones) 
t)ottom fine, top OR turn book 



10. Line ofder altered 



11. Left page before right 

1 2. One change in word order 

1 3. One change in letter order 



1 4. One change in letter order 

15. Meaning of? 



16. Meaning of period/Tuii stop 

1 7. Meaning of comma 

18. Meaning of quotation marks 

19. Locate M m H h (Sand) OR 
Tt Bb (Stones) 



20. Reversible words (was. no) 



21 . One letter, two letters 

22. One word: two words 

23. Rrst & last letter of word 

24. Capital letter 




Directions 
1 



2. 



3. 



4. 



5. 



Place the pupiTs ID label on the back of the lonm. 
if there is no 10 label for a pupil, please provide 
student number, birthdate, student's legal name 
(last, first, MO, grade, arx) school code in the 
space provkied. 

Put an X in the blank next to the fonm of the test 
the student took (either Stones or Sand). 

In the score column, place a 1 (one) besWe each 
correct item. If the item was incorrect, place a 0 
(zero) in the column. 

Record the total number of items correct in the 
test score box. 

Turn this form over and enter data from the 
Dfctaton test. 



2\} 



Date: 



DICTATION INDIVIDUAL SCORING SHEET 

TEST SCORE 



23 



School Name: 




Classroom Teacher 



Th e 
1 2 



bus 
3 4 5 



I s 
6 7 



com 
8 9 1 
0 



I n g. 
1 1 1 
1 2 3 



I t 
1 1 
4 5 



i I I 



w 

1 1 1 
6 7 8 



Stop 
12 2 2 
9 0 12 



here 

2 2 2 

3 4 5 



to let me get on. 
22 223 33 333 33 
67 8 9 0 12 345 67 



Directions 

1 . Be certain you have completed the required information at the tx)ttom of the form or placed an ID label on the fonn. 

2. Follow the directions for administering and scoring the Dictation test. 

3. In the blank above each phoneme, place a 1 (one) if the pupil responded correctly. If the phoneme was incorrect, 
place a 0 (zero) in the blank. If the phoneme was not attempted, do not mark anything on the fine. 

4. Record the total number of con-ect phonemes in the test score box. 

5. Return this fomri to your program evaluator at the Department of Program Evaluation, 52 Starting Street. Keep a copy 
in your files. 





PLACE LABEL HH^ 


NAME 

lAST 


FIRST MI 


STXJDENTNa 


BIRTHDATK 

M M D D Y Y 


SCHOOL COLS 


GRADE 
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Teacher Census Form 
1993-94 
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Social Security Number • - 

Name 

(Legal Name for Mailing Labels) 

School Assignment Cost Center 

Your Program Coordinator/Teacher Leader 



List all Chapter 1/DPPF programs you are involved with: 

Program Program Code 

2. ^ 

3. '. 

4. 

Full-Time Emptoyee 

or (check one) 
Part-Time Employee 



Numt)er of Reading Recovery sections per day 
Number of Early Literacy -Gr. 1 groups per day 
Number of Early Literacy -Gr. 2 groups per day 



3:j 
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ESEA • Chapter 1 
Parent Invotvement Log 
1993-94 



Program Code Last (Name oJ PupiO Rrst Grade 



Parent/Guardian Address Z%> Phone Number 

THE COLLECTION OF PARENT INVOLVEMENT DATA JS REQUIRED BY CHAPTER 1. 

Please check if the following two activftjes occuned for this pupil anytime this year. 



B 



Parent helped child with homewoik 
Parent read to child or chitd read to parent 



DIRECTIONS: Please indicate in the fields below the date, activity, and name of parent/guardian. 
Obviously, you may keep expanded notes about activities somewhere else. 

EJala ActrvTty* Attendee(s) 

MMDDYY (1 -5) Parent/Guardian 



*Kinds of Parent Involvement to record for the column labeled Activity 

(1 ) Involved in planning (do not include advisory council) 

(2) Group meetings (do not include advisory council) 

(3) IrxJividual conferences (telephone conferences included) 

(4) Parental classroom visits 

(5) Honoe visits 
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Columbus Public Schools 
ESEA Chapter 1 Reading Programs 

Collection Fomi for READING DESIRED OUTCOME 1 
^'Evidence of Strategic Processing" 

1993-94 



student l»Qai Name . 

Last, Rfst 

Student BirtfxJata Grade 

M M D D Y Y 
Student Number 



Program Teacher Name _ 



Program Code 

School 



RATIONALE One of the benchmarks for determining whether or not a student is deemed 

AND successful as a reader is if the student exhibits behaviors which dispJay strategic 

PROCEDURE: processing over a period of time. Three of these behaviors are listed below. The 

student should be observed over a period of time (the full school year) and will 
have met this desired outcome if he/she appropriately exhibits each behavior at 
least once during the obsetvational periods. The program teacher should 
observe these behaviors multiple times during the treatment period and record 
the behaviors, when observed, on the form below. 



CHECKLIST 



DIRECTIONS: 



Place a "X" (check) in the appropriate space when the behavior is consistently 
obsen/ed. 



OUTCOME INDICATORS 



OBSERVATIONAL PERIODS 



Behavtors 

1 . Constaicts Meaning 

2. Monitors Reading 

3. Integrates Sources of Infonmation 



SepTNov. 



AprTMay 



Please share this with the classroom teacher during your conference time. Do Dot 
send a copy of this form to the new school when a student transfers to another 
school. You will need this Information to complete each pupil's PDS in the 
Spring. Also, please send a copy of this form to your coordinator at the end of 
the year 
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Appendix F 
Ifxjependent Reading Record Sheet 
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Colum&uS PudMc Schools March 28. 1994 

Compensatory Eoucation Prograrts 9.18 



SHE£^ 
B 264 



SCHOOL CODE 



PUPIL DATA SHEET 
PRCGQAM CODE 9 4 3 0 4 SSN 



SCHOOL NAME 



PROGRAM NAME 



TEACHER NAME 



1 . STUDENT NAME / : /_ 

1 ast ^1 '"St mi 



2. STUDENT NO. 



GRADE 



BIRTHDATE 



/ / 



3. AVERAGE HOURS PER WEEK OF INSTRUCTION 



4. 


PUPIL PROGRESS 


NONE 


SOME 


5. 


IS THIS PUPIL ENGLISH SPEAKING? 


NO 


YES 


6. 


WAS THIS PUPIL DISCONTINUED? 
(CAREFULLY READ GUIDELINES) 


NO 


YES 


7, 


PARENT HELPED WITH HOMEWORK? 


NO 


YES 


8. 


PARENT READS TO CHILD OR CHILD R6ADS 
TO PARENT? 


NO 


YES 



MUCH 



FOR NUMBERS 9-13. FILL IN THE NUMBER OF THIS PUPIL'S PARENTS INVOLVED 
IN EACH ACTIVITY DURING THE vEAR AND TOTAL NUMBER OF CONTACTS, 



NO. OF PARENTS 



TOTAL NO . OF CONTACTS 



10. 



PLANNING 



GROUP MEETINGS 



11. INDIVIDUAL CONFERENCES 



12, 



13 . 



CLASSROOM VISITS 



HOME VISITS 



14. NUMBER OF DAYS SERVICE SCHEDULED 
(CAREFULLY READ INSTRUCTIONS) 



15. NUMBER OF DAYS SERVICE RECEIVED 
(CAREFULL/ READ INSTRUCTIONS) 



16. NUMBER OF LESSONS THRU 05-13-94 



THRU 05- 13-94 



THRU 05- 13-94 



17. WHILE IN YOUR CLASS, the Number of BoOkS Read at 
Text Reading Level Greater than 7 



4b 



(CvER) 



BEST COPY AVAILABLE 



SHEET 
S 264 



Columdus Public Schools 

Compensatory Education Programs 

PUPIL DATA SHEET 

PROGRAM CODE 9 4 3 0 4 
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Ma'-ch 28. 1994 
9: 18 



STUDENT NAME _ ^ 



/ 



last first. 

STUDENT NO. GRADE BIRTHOATE / / 

INDICATE THE STRATEGIC PROCESSING BEHAVIORS DISPLAYED BY PUPIL: 

18. CONSTRUCTS MEANINGS NO YES 

19. MONITORS READING NO YES 

20. INTEGRATES INFORMATION SOURCES NO YES 




Prepared by 
Office of the Deputy Superintendent 
Department of Program Evaluation 
( pi f dps ) ' 
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